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LINKING TO VIDEO INFORMATION 
Background 

This invention relates generally to linking 
information displayed on a video display to additional 
information. 

5 Hyperlinks (also called anchors or hotspots) are video 

display locations which a user can select to access a 
document or a web site (i.e. a collection of documents). 
Generally, a given document such as a hypertext markup 
language (HTML) document may have a hyperlink programmed 

10 onto the web page by indicating a given location displayed 
on the web page. When the user operates a pointing device 
on the designated embedded linking area, additional 
information may be accessed. Conventionally the embedded 
linked area is accessed by highlighting the linked area and 

15 operating a mouse button while a cursor or highlighting is 
arranged to point to the hyperlinked site. 

The additional information may be additional video 
information, textual information, a web page or any of a 
variety of other information. A uniform resource locator 

20 (URL) is used to access the additional information. 

Absolute URLs locate external sites and relative URLs point 
to locations on the same web site or document. 
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Of course, the hyperlink works because the web page is 
programmed to include the embedded pointer. Thus, the 
hyperlinks become part of the code which defines the web 
page. The hyperlinks can be URLs or images which have 
5 associated URLs. 

Because the hyperlinks are hard coded into the web 
page, once the hyperlinks are defined, it is relatively 
difficult to change them. Thus, if a given hyperlink 
points to a given source such as a web page, it generally 
10 will always point to that source unless the HTML code is 
rewritten. 

In a number of circumstances, it would be desirable to 
enable the linking software to be redefined over time. 
Thus, at one time interval, when a user selects (or mouse 

15 clicks on) a given icon on a web page, one thing would 

happen and at another time a different thing would happen. 
This would allow greater flexibility and enables the web 
page creator to link to different sites at different times. 
For example the web page owner may sell the hyperlinks to 

20 different users at different times. 

In conventional magnetic or optical media such as hard 
disks, magnetic tape, compact disks, digital video disks 
(DVD) , and floppy disks, hyperlinking is generally not 
utilized. However, it would be desirable to enable 

25 reprogrammable hyperlinks from a variety of media including 
media storing video presentations such as movies. 
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Thus, there is a continuing need for better ways to 
link video information to other information in a way which 
may be readily reprogrammed and which is sufficiently 
flexible to enable additional information to be linked to 
5 information in a video presentation at various times. 

Summary 

In accordance with one aspect, a method of linking 
information to video information includes linking the video 
information with other information based on the location of 
10 the video information on a frame and a frame identifier. 

The other information may be accessed in response to a user 
selection of a frame location. 

Other aspects are set forth in the accompanying 
detailed description and claims. 

15 Brief Descriptio n of the Drawings 

Fig. 1 is a front elevational view of one embodiment 
of the present invention; 

Fig. 2 is a schematic depiction of one implementation 
of the present .invention; 
20 Fig. 3 is a schematic depiction of another embodiment 

of the present invention; 

Fig. 4 is a depiction of how a frame may be broken up 
into distinct locations with embedded links which may be 
reprogrammed in accordance with one embodiment of the 
25 present invention; 
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Fig. 5 is a flow chart showing software for 
implementing one embodiment of the present invention in 
connection with a client; 

Fig. 6 is a flow chart showing software for 
5 implementing one embodiment of the present invention in 
accordance with a server; and 

Fig. 7 is a block diagram showing a client in 
accordance with one embodiment of the present invention. 

Detailed Description 
10 A computer system 10 may include a processor-based 

unit 12 coupled to a display 14 such as a conventional 
television receiver having a display screen 22. A remote 
control unit (RCU) 16 may be utilized to remotely control 
the unit 12 and the display 14. Thus, in accordance with 
15 one embodiment of the present invention, mouse style 
commands may be produced by operating the directional 
buttons 26 to move a cursor image or highlighting on the 
display screen 22 to implement a conventional pointing 
function. 

2 0 The RCU 16 may be an airwave transceiver 24 which 

communicates with transceivers 18 on the units 12 and 20. 
In this way, airwave communications may be undertaken 
between the components . The user can then control each 
component by providing input commands through the cursor 

25 controls 26, the pushbuttons 28 or the keypad 30. 
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While the present invention has been illustrated in 
connection with a processor-based unit 12 which may be 
called a set top computer system, the present invention is 
applicable to any of a variety of processor-based systems 
5 including desktop computers, laptop computers, and 
processor-based appliances, as additional examples. 

The RCU 16 may conveniently generate and receive 
airwave signals such as infrared, radiowave or ultrasonic 
signals. While the present invention is illustrated in 

10 connection with a processor-based system 10 which uses an 
RCU 14 as a pointing device, the present invention is 
equally applicable to processor-based systems which are 
controlled using other pointing devices including a mouse, 
a rollerball, or a touchpad, as additional examples. 

15 In accordance with one embodiment of the present 

invention, the system 10 may be one of a plurality of 
similar receivers 10, shown in Fig. 2, which receive video 
transmissions (indicated by the arrow 35a) from a server 
34. Each receiver 10 may communicate through a back 

20 channel 3 5b, in accordance with one embodiment of the 
present invention, with the server 34. Thus, as 
illustrated, two-way communications may be implemented 
between the server 34 and each of the plurality of 
receivers 10. 

25 The server 34 may receive video content such as 

television programming from a content provider 32. The 
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server 34 may also send communications to the content 
provider 32. In addition, the server 34 may communicate in 
a two-way communication protocol with a link library 75 in 
accordance with one embodiment of the present invention. 
5 In one example of an implementation of the present 

invention, television programming may be transmitted from 
the server 34 to each of a plurality of receivers 10. At 
each receiver 10, a pointing device may be utilized to 
select a particular location in a particular video frame in 

10 order to access additional information. The selection may 
be transmitted over the back channel 35b from a receiver 10 
to a server 34. In response, the server 34 may access the 
link library 75 to provide additional information 
corresponding to the particular location and the particular 

15 frame selected by the user of a receiver 10. That 
information may then be transmitted, for example as 
indicated by the arrow 35a, from the server to the receiver 
10. Alternatively, the additional information may be 
obtained from the content provider 32. 

20 A variety of transport media may be utilized to convey 

the additional information. For example, telephone, cable, 
satellite, and networked connections, including Internet 
connections, may be utilized to implement the transport 
media . 

25 While the embodiment illustrated in Fig. 2 involves a 

video transmission system such as a television broadcasting 
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system, the present invention is in no way limited to 
broadcast applications. It may likewise be applicable to 
any of a variety of transmissions involving visual 
information including video transmissions, movie 
5 distribution systems, or Internet web pages, as additional 
examples . 

In accordance with still another embodiment of the 
present invention, a medium 70 may be provided which 
contains video information. The medium 70 may be, as 

10 examples, a floppy disk, a hard disk, a compact disk, a 
digital video disk, or any of a variety of optical or 
magnetic media. The medium 70 may store one or more video 
images which may be displayed on a conventional processor- 
based system. The processor-based system may also include 

15 a system memory 72 which may store a variety of programs 
which may be executed on the processor-based system. 

When the user selects a given location and frame of an 
image currently being displayed on the system, the system 
memory 72 may record the selected location and its frame. 

20 The memory 72 may access associated information, which is 

stored on the medium 70, to display additional information, 
in accordance with one embodiment of the present invention. 
The nature of additional information is essentially 
boundless and is defined only as information which is 

25 linked by design to a given location in a given frame in 
the content originally stored on the medium 70. 
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In the embodiments illustrated in Figs. 2 and 3, video 
data may define a video frame or a plurality of video 
frames. Each video frame may be identified (if more than 
one video frame is involved) by a frame identifier. The 
5 frame identifier identifies each frame of a plurality of 
video frames which, for example, may make up a video 
presentation such as a movie, a television program, or a 
web site as examples. In addition, a plurality of 
locations on a given frame may be identified relative to 

10 other frames. Thus, when the user selects a given location 
and a given frame, that location and the identified frame 
itself provide an indication of the focus of a given user. 
The given location on a given frame may be linked through 
the active media (or through other media) with additional 

15 information which may be associated with the selected 
location. 

One convenient frame identifier is the time code in 
accordance with one of a variety of industry standards 
including the Society of Motion Picture and Television 

20 Engineers (SMPTE) . Conventionally, the time codes are 

utilized to enable synchronization between audio and video 
tracks. The SMPTE time code synchronization system is a 
biphase mark longitudinal time code (LTC) which can be 
recorded onto the audio track of a video tape in one 

25 example. 
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Another time code is the vertical interval time code 
(VITC) . The VITC may be advantageous in some applications 
because it can be read even when the medium storing the 
video is paused. 

5 The SMPTE time code is a broadcast standard time which 

may be recorded in the format HH:MM:SS;FF, where FF is a 
frame number between 00 and 29, HH is a two-digit code for 
hours, MM is a two-digit code for minutes and SS is a two- 
digit code for seconds. Assuming a frame rate of 3 0 frames 

10 per second, the SMPTE time code may identify every frame of 
a video sequence such as a movie, a television program or 
other video information. 

While the present invention, in one embodiment, uses a 
time code to identify a given frame, the present invention 

15 is in no way limited to the use of time codes. The time 
code is simply a convenient way to identify one of a 
plurality of frames. Any other technique may also be 
utilized to identify each of the frames including simply 
providing each frame with a sequential identifier. 

20 A frame 36, illustrated in Fig. 4, may be overlaid by 

a grid system having an X screen direction 40, a Y screen 
direction 42 and a frame identifier 38. The frame 
identifier provides the hours, minutes and seconds 
indication followed by a 00 to 29 frame number indication. 

25 In the embodiment illustrated in Fig. 4, the X and Y screen 
directions provide rectangular coordinates to identify a 
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plurality of grid segments such as the segments 44 and 46. 
In this way, every image defined on the frame 36 may be 
identified by one or more grid coordinates in the X screen 
and Y screen directions. 
5 Thus, as illustrated in Fig. 4, a given frame 36 may 

have two embedded links, for example a link 1 and a link 2 
associated with the locations 44 and 46. If these 
locations are selected by the user, they automatically link 
to additional information which may be stored, for example, 

10 on the medium 70 in the embodiment of Fig. 3 or to the link 
library 75 or content provider 32 via the server 34 in the 
embodiment of Fig. 2. 

While Fig. 4 illustrates an embodiment in which a 
rectangular grid work is utilized to define locations, any 

15 of a variety of location identifying techniques may be 

utilized. For example, polar coordinates may be utilized, 
a patchwork of regions may be identified by location 
numbers, and any of a variety of other indication 
identifying techniques may be used as well. As another 

20 example, one or more display pixels may be associated as a 
link to additional information. 

The user may select a location 44 or 46 using a 
conventional pointing device such as the RCU 16. When a 
particular item on the display has a cursor image 

25 associated with it, in one embodiment of the present 

invention, and a mouse button is operated (such as the 
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button associated with the controls 26) , that particular 
location is selected. In response to the selection of a 
particular location, additional information may be 
identified. That is, given the particular location in a 
5 particular frame, the processor-based system may search for 
information linked to that particular location in that 
particular frame. 

Thus, in one embodiment of the present invention, the 
content provider may know that a given location in a given 

10 frame is a particular product. When the user selects that 
location, the user may be provided with additional 
information, such as video information, about the 
particular product. 

Because of the location system described herein, the 

15 linked information may be added or changed at any time. 

For example, as users continue to select a given location 
on a given frame, the content provider or other entity may 
choose to provide additional information in response to 
repeated requests. 

20 Similarly, the information which is provided may be 

changed at any time. Because the linked information is not 
hard coded into the media, the information may be changed 
in response to the desire to update information, to change 
sponsorships, or to improve the quality of the information, 

25 as examples. 
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Thus, by providing a system of location identifiers, 
the need for hard coding of hyperlinks may be avoided. 
This allows a dynamic system in which the linked 
information may be varied over time to meet changing needs. 
5 In addition, it enables essentially every item in a given 
video display to be selectively linked to additional 
information. Moreover, there is no need to adjust the 
programming of a particular page such as Internet web page, 
but instead, the desired item can be identified by 

10 location. 

In the embodiment indicated in Fig. 2, the user 
selected locations together with the frame identifier may 
be transmitted back to the server 34 over the back channel 
35b to the server. The server 34 may then be responsible 

15 for obtaining the linked information for example from the 
link library 75 or the content provider 32. In this case, 
the receiver goes outside its own system to obtain the 
additional information through the link. 

In contrast, in the embodiment illustrated in Fig. 3, 

20 the linked information may be contained elsewhere on the 
same media 70 that originally stored the video data. In 
this case, the additional information may be found entirely 
within a single processor-based system. 

The software 48, resident on the receiver 10, may 

25 begin by receiving the video data as indicated in block 50 
as shown in Fig. 5. The link may be established between 
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that data and the time code system that is utilized by the 
particular receiver. For example, if the user uses the 
SMPTE time code system to identify selected locations on 
selected frames, synchronism of that system is established 
5 (block 52) . 

Next the system awaits a user selection as indicated 
in diamond 54. The user selection may correspond to the 
use of a pointing device, such as the RCU 16, to select a 
particular location on a particular frame. Once the user 
10 makes the selection, the location identifiers are stored as 
indicated in block 56. The location identifiers may 
identify a particular location in the frame as well as a 
particular frame. One such identifier is the SMPTE time 
code . 

15 In some receivers 10, a recording system may be 

provided wherein data is continuously stored onto a 
magnetic or optical storage media such as a hard disk 
drive. When the user wishes to access additional 
information for viewing, the ongoing video stream may be 

20 stored. In systems which use a recording media of the type 
described, this may be accomplished by pausing the active 
display, continuing to record the received video, such as a 
television program, in the background, while displaying 
additional information selected for access by the user 

25 through the linking system described above. 
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Thus, in these systems, sometimes called broadcast 
pause and resume systems, with this type of recording 
media, the pause function may be automatically activated in 
response to a user selection of a given location on a 
5 particular frame. The pause remains in effect until such 
time as the user has finished viewing the additional 
information and indicates a desire to return to the ongoing 
video program. Thus, if the pause is active, as determined 
in diamond 58, the pause may be automatically instituted 

10 for the duration of the excursion into the additional 
information as indicated in block 60. 

Thereafter, the location identifiers are transmitted 
through a source of video information associated with the 
link (block 62) . Thus, in the embodiment shown in Fig. 2, 

15 the location identifiers may be sent outside of the 

processor-based system 10. In contrast, in the system 
shown in Fig. 3, the information may be accessed internally 
of the processor-based system. 

The location identifier for the content may be 

20 accessed such as a URL or other identifier as indicated in 
block 64 . When the user selects the content as indicated 
in diamond 66, content may be automatically displayed as 
indicated in block 68. Again, when the user indicates an 
intent to resume the original video material returning from 

25 the linked information, in systems which use a on-going 
recording of a received video stream, the system may 
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automatically transition back to display the recorded media 
(block 70) . The system may accelerate through the replay 
of the recorded media to attempt to return to real time 
display of the just received video information, as 
5 indicated in block 70. 

Turning next to Fig. 6, software 74 which may be 
resident on the server 34, may begin by transmitting video 
data to one or more receivers as indicated in block 76. 
Synchronization is established with the receivers as 

10 indicated in block 78. When a request for a location 

identifier is received, as indicated in diamond 80, the 
requested links may automatically be located as indicated 
in block 82. Thus, in the embodiment illustrated in Fig. 
4, the coordinates of the particular selected location and 

15 its frame may be compared to a database containing links 

for a variety of locations on a variety of frames. When a 
link is accessed, it can be returned to the receiver. The 
return link may be a URL or other script that directs the 
receiver to the source of the information, or the 

20 information itself may be provided directly from the server 
to the receiver as indicated in block 84 . 

In one embodiment of the invention, the user may cause 
indicia, such as highlighting, to appear at those locations 
that are linked to other information. This feature may be 

25 activated, for example, during a software set-up sequence. 
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Finally, referring to Fig. 7, the receiver 10 may 
include a processor 150 coupled to an accelerated graphics 
port chipset 152 (see the Accelerated Graphics Port 
Interface Specification, Revision 1.0, dated July 31, 1996 
5 available from Intel Corporation, Santa Clara, California) . 
The chipset 152 may be coupled to system memory 158 and an 
AGP port 154 . The port 154 communicates with a graphics 
accelerator 156 and a television receiver 14 in one 
embodiment of the present invention. 

10 A bus 160, coupled to the chipset 152, also couples a 

TV tuner/capture card 162 coupled to an appropriate antenna 
or other transport medium access port 164. A bus 160 also 
couples a bridge or interface 166 which may communicate 
with a hard disk drive 168. The software 48 described 

15 previously may be stored on the hard disk drive 168. In a 
broadcast pause and resume system the hard disk drive 168 
may be buffered so that it may essentially simultaneously 
record and playback information in an interleaved or 
multiplexed series of store and playback sequences. 

20 A second bus 170 may be coupled between the bridge 166 

and a serial input/output device (SIO) 172 and a basic 
input/output system (BIOS) 174. The SIO 172 may 
communicate with an infrared transceiver 18 which is part 
of the processor-based unit 12. The transceiver 18 

25 communicates with a transceiver 24 on the RCU 16. The RCU 
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16 also includes a controller 150a coupled to a memory 158a 
and the keypad elements 26, 28 and 30. 

While the present invention has been described with 
respect to a limited number of embodiments, those skilled 
in the art will appreciate numerous modifications and 
variations therefrom. It is intended that the appended 
claims cover all such modifications and variations as fall 
within the true spirit and scope of this present invention. 

What is claimed is: 
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